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0.  fatrodttction 

An  Interval  linear  program  i«  any  problem  of  the  form 

(IP)  :  maximiae  c^x 
•ttbject  to 
b“  SAxSb**" 

where  the  matrix  A  ,  vectore  b**  ,  b**‘  »  c  are  given.  A  finite  iterative 
algorithm  for  aolving  (IP)  is  given  here  which  is  based  on  the  Dantzig-Wolfe 
decomposition  principle  [6]  .  An  alternative  iterative  method  for  solving  (IP) 
is  given  in  [8]  and  [9]  . 

(IP)  can  always  be  solved  by  the  standard  linear  programming  tech¬ 
niques  (e.g.  [4]  ,  [5]  )  by  treating  each  two-sided  constraint  as  two  constraints 
and  expressing  each  unrestricted  variable  as  the  difference  of  two  nonnegative 
variables.  Since  this  procedure  increases  considerably  the  effective  problem 
sise  and  since  problems  of  form  (IP)  are  common  in  many  applications  (e.  g. 
in  structural  analysis,  production  planning,  approximation  problems,  etc.; 
see  [2]  ,  [3]  ,  and  [8]  )  ,  it  is  desirable  to  have  special  techniques  for  solving 
(IP).  Furthermore,  (IP)  is  a  sufficiently  general  model  to  cover  all  bounded 
linear  programs  so  that  any  method  for  solving  (IP)  may  be  viewed  as  an 
altemative  method  for  linear  programming.  In  particular,  a  problem  in  the 
standard  form 


maximize  c^x 
subject  to 


Ax  !  b 
x^O  , 
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if  bounded;  is  equivalent  to  the  (IP) 
maximize  c^x 

0e  te 

-Me  ^  A  X  ^  b 
0  ^  X  ^  Me 

where  e  is  a  vector  of  ones  and  M  is  a  sufficiently  large  positive  scalar. 

Notations  and  preliminaries  are  given  in  section  1.  In  section  2  it  is 
demonstrated  that  any  (IP)  can  be  converted  to  decomposable  form  so  that  the 
decomposition  method,  developed  in  section  3,  can  be  applied.  A  numerical 
example  is  given  at  the  end  of  section  3. 

1.  Notations  and  Preliminaries 

The  following  notations  are  used: 
iff  if  and  only  if; 

s.  t.  subject  to; 

{x;f(x))  the  set  of  x  satisfying  f(x); 
the  empty  set  ; 

R*'  the  n-dimensional  real  vector  space; 

j^mxn  space  of  mxn  real  matrices; 

j^mxn  {X  e  j  rank  X  =  r}  ; 

r 

I^  the  nxn  identity  matrix; 

e,  the  i--  column  of  I  ; 

i  n 

c  the  vector  of  ones; 

(the  dimension  of  e  and  e^  will  be  clear  from  context) 

For  any  x,  y  f  r”  : 

X  ^  y  denotes  x^  ^  y^  for  i  =  I, . . .  .n  ; 
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X  X  y  denote*  x  is  perpendicular  to  y  (i.  e.  =  0). 

For  any  subspace  L  of  R^: 

X  -f  L  denotes  the  manifold  {x4-t:  f,cL}; 

For  any  A  C  R*”**'  denote  by: 

A^  the  transpose  of  A  ; 

R(A)  the  range  space  of  A  (i. e. 

(  y  •  R*”  :  y  ■  A  X  for  some  x  •  r“  )  )  ; 

N(A)  the  null  space  of  A  (  L  e.  ( x  C  R*^  :  A  x  x  0)  ; 

A  ^  the  inverse  of  A  t  if  nonsingular* 

An  interval  linear  program  or  interval  linear  programming  problem 
is  any  problem  of  the  form 

(1)  (IP)  :  maximize  c^x 

s.t* 

(2)  b"  S  A  X  S  b'*’ 

vrhere  c  *  (c^)  ,  b"  «  (bj )  ,  b'*’  «  (bj” )  ,  and  A  *  (a^j)  (i  *  1, , . . ,  n  : 

J  ■  l»...*m)  are  given,  with 

(3)  b’lb'*'  . 

Let  S  be  the  set  of  points  satisfying  (2) 

(4)  S  =  (stR“:b’SAxSb+). 

A  point  X  C  S  is  called  a  feasible  solution  of  (IP).  Problem  (IP)  is 
feasible  if  S  /  0  ,  otherwise  infeasible.  If  A  c  R^™^"  (IP)  is  feasible 
for  any  b*  ^  b^  since  R(A)  =  R*^  .  (IP)  is  bounded  i£  S  /■  0  and 
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4. 

and  max  c*’x  <  *  .  pthenwiae  unbounded.  Clearly  (IP)  i>  funded  if  S 
X*  S 

is  a  bounded  set:  the  converre  Is  false.  Boundedness  is  characterized 
in: 

Lemma  1  ([11):  Let  S  4  fi  »  Then  (IP)  Is  bounded  lii 
(5)  c  1  N(A)  .  Q 

We  conclude  that  all  bounded  (IP)  problems  have  c  x  N(A)  and 
consequently  any  (IP)  with  c/  N(A)  is  uninteresting  . 

Condition  (5)  may  be  verified  if  a  basis  for  N(A)  is  available.  The 
foUowin,^  recipe  may  be  used  to  compute  such  a  basis; 

Lemma  2  (  [11 )  ;  Let  Ac  and  E  C  satisfy 

~  —  '  m  ■ 

P 

Then  rank  (A)  *  r  aud  the  columns 


(M 


EA  = 


J 


(m-r)xn 

where  P  is  a  permutation  matrix, 
of 


(7) 


iL) 


form  a  basis  of  N(A)  . 

The  following  example  will  demonstrate  the  use  of  lemma  2: 
Example  1;  Find  N  for  the  matrix 


d'Agonalize  A  an 


4  2  0  \ 

2  0-2 
2  2  2  / 

I  -I  I  / 


shown  in  the  table  (pivot  elements  are 


circled): 


A<'>- 

a<2). 

a<3). 


/©  4  2  0 

-T  2  0  -2 

2  2  2  2 

\  0  I  -I  I 


/  I  0  2/3  4/3 

f  0  I  0  -0 

I  0  0  (L  0 

\  0  0^^  4/3 


•5“ 


(int«rch*nging  rcmt). 


Computationally,  Umma  2  if  a  very  naive  etatement,  but  we  will  ignore 
the  computational  difficultiei  of  ill*condltioning  for  which  the  reader  is 
referred  to  [10]  . 

It  will  now  be  shown  that  any  (IP)  with  c  i  N(A)  can  be  converted  to 
an  equivalent  (IP)  having  full  column  rank  (i.  e.  with  A  e  )  . 

Lemma  3;  Let,  A  «  and  D  •  r”“  fuch  that 


R(d‘)  =  R(A*)  . 


(3) 


Then 


ad‘  c 


Proof;  Obvious  • 


Lemma  4;  Suppose  that  (IP)  is  given  with  A  (  t  c  x  N(A)  and  let 

D  be  given  as  in  lemma  3.  Then  the  optimal  solutions  of  (IP)  are 
d‘  y*  +  N(A) 

where  y*  is  any  optimal  solution  of 
maximize  y 


b"  S  A  y  $  b'*'  . 

Proof;  UsLig  the  facts  that  c  x  N(A)  and  R(A^)  »  N(A)‘*‘  (e. g.  [7])  it 
follows  that  the  optimal  solutions  of  (IP)  are 
X*  +  N(A) 

where  x*  is  any  optimal  solution  of 
maximize  c^x 


b"  ^  A  X  5  b”’’ 

X  c  R(a‘)  , 

From  (8)  it  follows  that  any  x  C  R(A^)  can  be  written 

X  =  D^y 

for  some  y  C  R^  .  Substituting  (15)  in  (13)  and  in  problem  (1),  (2),  (14) 
gives  the  desired  result.  i-i 


In  what  follows,  it  is  assumed  that  lemma  4  has  been  applied,  if 
necessary,  so  that  the  problem  to  be  solved  has  a  coefficient  matrix  of 
full  column  rank.  This  assumption  is  not  essential,  but  it  simplifies 
notations,  permits  the  use  of  ordinary  (rather  than  generalized)  inverses. 
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(16) 


(17) 


and  should  rsduce  computational  effort  If  the  original  problem  did  not 
have  full  column  rank. 

Tha  following  elementary  result  Is  a  special  case  of  the  result  given 
in  [1]  and  will  be  used  to  develop  the  algorithm  below: 

Let  (IP)  be  given  with  A  •  and  (3).  Then  the  optimal 

solutions  of  (l)(  (2)  are  all  the  vectors  of  the  form 

X*  .  A"*  .* 

where  the  components  of  s*  C  R**  are  defined  by 


s?  « 


b. 

‘J 


£or_  J  and  0  s  6j  5  I  for  thos.  j  with  (c^A .0 


Proof:  Substituting 

(18)  s  «  Ax 

in  (l)i  (2)  we  obtain  th»  equivalent  problem 

(19)  maximise  c^a'^z 


s.t. 

(20)  b"  f  z  !  b’*’ 

whose  optimal  solutions  are  the  vectors  z*  given  by  (17).  The  reverie 
substitution  gives  (16).  q 

Conditions  for  the  explicit  solution  of  the  general  IP  were  given  in  [U]. 


2.  Converting  (IP)  to  Decomposable  Form 

A  decomposable  interval  program  is  any  problem  having  the  form 
(1)  (DIP):  maximise  c^x 

s.  t. 

(21)  b"  5  Ax  -  b 


“8“ 


b  =  A  X  «  b 

where  A  and  A  are  nonsincnlar  (say  A  ,  A  C  ,  b  .  -  b^  ,  and 

P 

b  «  b  .  The  method  developed  in  section  3  below  is  applicable  to  any 
(OIP)  hence  to  any  bounded  (1P)»  since  any  bounded  (IP)  can  be  converted 
to  an  equivalent  (DIP),  as  we  now  demonstrate: 

Consider  the  (IP): 

maximize  c^x 


b”  -  A  X  ^  b^ 

where  (3)  is  satisfied  and  A  C  R 
is  bounded  since  N(A)  ={0}. 


mxr 


(e.  g.  lemma  4).  This  problem 


Rearrange  the  constraints  as  necessary  to  put  (1),  (2)  in  the  form 
maximize  c^x 


subject  to 

'’i  *  *  *’i 

bj 

b-  5  A,x?  bj 

where  Aj  C  R”'  ,  A^  «  R^'  .  and  Aj  c  R*"*'”"’**'  .  That  la, 

Aj  is  a  nonsingular  subma.trix  of  A,  is  any  submatrix  liaving  full 
row  ranlc  whose  rows  are  not  in  A^  ,  and  A^  is  made  up  of  the  rows  of 
A  not  in  A^  or  A^  •  Note  that  q  is  not  uniquely  defined,  but  as  we 
shall  see  later  it  is  desirable  to  make  q  as  large  as  possible  (q  =:  0  is 
always  possible). 

Clearly  we  can  always  choose 

a  subset  of  the  constraints  (23) 


«Awa(V«AA,«’ANbee«.'M4(''^Si 


.  Problem  (IP)  is  not  ch&nged  by  including 


such  that  ^  9 

tome  constraints  more  than  once»  so  (1),  (2)  may  be  written 


(1) 

maximize  c  x 

subject  to 

(23) 

b-SA,*Sb+ 

(24) 

**2  ^  ‘^2*"  ^2 

(26) 

hZ  -  Bx  $  bt 

4  4 

(25) 

b^  t  A^xt  bj 

Finally,  observe  that  x*  is  an  optimal  solution  to  (IP)  iff  (x***  ,  y’^  ) 
it  an  optimal  solution  to  the  following  bounded  problem  which  clearly  has 
form  (OIP): 

(1)  maximize  c^x 

subject  to 


A  procedure  for  identifying  appropriate  ^ 

is  demonstrated  in  the  following  trivial  example: 

Example  2t  Transform  the  following  (IP)  problem  to  form  (DIP): 
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maximize 


subject  to 


/*  ’ 

/i  i\ 

/  \ 

1  ^ 

2 

'  2  2 

fxA 

3 

3 

< 

0  1 

1 

* 

4 

-1  -1 

5 

, 

2  Oj 

Applying  Gauss-Jordan  eliminations  tn  A  we  obtain  (pivots  circled): 


/0  M 

/I 

/.  o\ 

/  2  2  ' 

0  0 

o 

O 

0  . 

0  0 

0  1 

1 

1 

0  0 

0  0 

\  2  “I 

\  0 

\0  0/ 

Since  rows  I  and  3  contained  pivots  we  conclude  that 


is  a  suitable  nonsingular  submatrix  of  A, 

Rearranging  A  with  matrix  A^  at  the  bottom,  we  repeat  the  above 
proceedure: 


@ 

2  \ 

/• 

/ 1  0^ 

-1 

- 1  1 

'  0  0 

1  0  0 

2 

0 

0  0 

0  1 

1 

0  oJ 

1  0  0 

\  0 

1  1 

\  0  If 

\o  0 

V.'e  conclude  that  row  4  of  A  is  linearly  dependent  on  row  2  (since 
all  its  elements  vanished  after  step  1)  so  that  row  4  must  fall  in  A^  . 
Furthermore  since  r  =  2  pivots  were  found  before  reaching  the  bottom 
r  rows  we  conclude  that  B  =  0  ,  and 
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since  pivot*  were  contained  in  rows  I  and  3  (i.e.  rows  2  and  5  of 
the  origixial  matrix). 

The  equivalent  (DIP)  is  therefore: 
maximise  x^  +  X2 
subject  to 


3.  The  Decomposition  Algorithm 

Problem  (DIP)  :  (1),  (21).  (22)  may  be  equivalently  written 
maximize  c^  S 
subject  to 

(29) 

b“  ^  Jx 
b  5  Ax  -  b^  . 

In  this  section  we  develop  an  algorithm,  for  solving  problem  (29)  which 
is  related  to  the  Dantzig- Wolfe  decomposition  principle  [6]  . 

Let 

(30)  S  *  {x  c  rP  :  b“  ^  Ax  $  b'*’  ) 

and  let  G  be  the  finite  matrix  whose  columns  are  the  extreme  points  of 
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(31) 


(32) 


(31) 


S  .  Since  A  is  nonsingulari  S  is  a.  bounded  polyhedron  so  that 
X  c  S  iff 

X  =  G  V  ,  e^v  =  I  ,  V  ^  0 

(i.  e.  X  is  a  convex  combination  of  the  extreme  points  of  S  )  .  An 
analagous  result  holds  for 

S  =  (x  e  rP  :  b  |Ax5  b^  ) 

A 

and  the  corresponding  matrix  G  whose  columns  are  the  extreme 

A 

points  of  S  . 

Consequently,  (29)  may  be  written 
maximize  c^  G  v 
subject  to 
G  V  -  Gv  =  0 
e*v  =  I 
e*v  =  I 
v,v  =  0  . 


Problem  (31)  has  the  "standard"  linear  programming  form  except  that 

A 

the  columns  of  G  and  G  are  not  immediately  known.  Indeed,  we  shall 
solve  (31)  using  the  simplex  algorithm  (e.  g.  [4]  ,  [5])  with  a  special 

^  A 

technique  for  generating  the  columns  of  G  and  G  one  at  a  time  as 
needed. 

Suppose  that  a  basic  feasible  solution  to  (31)  is  in  hand  with 
"simplex  multipliers"  (e.g.  [5]). 

(32)  (iT^,  •  • .  ,  »  ^2)  —  (x,  •  ^2^ 

Let  the  colunms  of  G  and  G  be  denoted  by  g^  (i  =  I,  •  •  • ,  N)  and 

A  ^ 

gj  (i  =  l,...,N)  respectively.  A  vector 


f-«i\ 

or 

\  0  1 

1 

i'l 

... 


(33) 


(34) 
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can  enter  the  ba*i«  if 


(».  0,  .  Oj) 


or 


(».  (Tj  ,  o^) 


/  i 

I 

\  0 


■«1 

0 

I 


-  c‘gj  .  (»  +  Oj<0 


(35) 


respectively  (i.  e.  it  has  a  negative  relative  cost). 

Following  the  standard  simplex  proceedure  we  bring  into  the 
basis  the  vector  with  the  smallest  relative  cost 

X  ■  min  (min  {(v  -  c^)  +  o^)  ,  rr^  (-w  ^  +  02) ) 

«i  h 


(36) 


(37) 


unless  X  2  0  which  indicates  the  present  solution  is  optimal.  Thus 
we  must  determine  the  extreme  points  and  g*  such  that 


and 


(w  -  c^)  g  *  ■  min  ((w  -  c*)  ) 

*i 

-w  g*  ■  mjn  (-V  g .  )  . 


But  min  ((v  -  c^)  ^. )  ■  min  ((v  -  c^j  x)  so  that  (by  lemma  5} 


(38) 


^*-,5-Vh+,5T  '■i’n 


id 


(39)  where  A"' a  (t^,.. .  ,t  ) 


(40) 


and  X 


_  a  {  i  ;  (;r  -  0*=)  tj  ^  ,  <  0  ) 


(L  e*  g  *  is  an  extreme  point  solution  of  the  subproblem 

min  (ir  -  c^)x  .  ) 
xc  S 
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Likewise 


where  A"^  =  (r.i . . . » t  ) 
I  p 


and  I  ^,<0}. 

T|  “  1 


If  X  <0  either 


enters  the  basis  depending  on  which  has  the  lowest  relative  cost*  The 
simplex  iteration  is  then  completed  to  obtain  a  "better"  basic  feasible 
solution  and  the  entire  procedure  is  repeated.  The  theory  of  the 
simplex  method  assures  finiteness  provided  proper  steps  are  taken  to 
treat  degeneracy. 

If  X  ^  0  the  present  solution,  call  it  ( v*  ,  v*  )  to  (31)  is 
optimal.  An  optimal  solution  to  (DIP)  :  (1).  (Zl),  (22)  is  then 

X  =  E  g,  V  ’  =  E  gj  Vj 

icflj  '  iefig  '  ' 


where  =  [i  ;  v^  >0  ) 

02=  {i  :  Vj  >0  }  . 

An  initial  basic  feasible  solution  can  be  found  using  artificial 
variables.  One  appioach  is  to  begin  with  the  enlarged  problem 
maximize  c*  G  v  -  Me^z 
subject  to 


e 


V  ,  v  ,  z  S 
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wher«  M  is  a  sufficiently  Urge  scaUr,  using  •  *  *|>  as  the 

starting  basis.  If  X  2  0  while  some  of  the  artificUl  variables 
(i.  e.  {  i  3  I, . . .  ,p+2})  are  still  in  the  basis  at  a  non- zero  level, 
problem  (DIP)  has  no  feasible  solutions. 

A  slightly  different  approach  for  obtaining  an  initial  basic  feasible 

mm  A 

solution  to  (31)  is  to  find  any  extreme  points  of  S  and  S  .  If  we  call 
these  points  g,  and  g,  respectively^,  then 


V  I' 

0  ±\  0 


t  0 


is  a  suitable  starting  basis  to  the  equivalent  problem 
maximize  c^  G  v  -  Me^z 


subject  to 

^  G  -  G  I 
t  P 

e  0  0 

t 


V  .  I 


v  ,  V,  z  -  0 


The  sign  in  front  of  |o^j  in  (46)  will  depend  on  the  sign  of  (gjj  -  g^.) 

and  has  purposely  been  left  ambiguous  to  simplify  notation.  An  example 
should  cUrify  the  use  of  (47). 


Exatr^le  3: 


maximize  x^  +  Zx^ 
subject  to 
0  S  X,  S  6 


Xj 


2  S  Xj  + 


-  9  s-3x^+  Xj,  s  9 

jy  Hcuristically,  a  good  choice  for  g  .  g  ,  would  seem  to  be  optimal 

extreme  point  solutions  to  nuat  c^x  and  max  c^x  respectively. 

XC?  XCS 
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(49) 


This  problem  has  the  form  of  (DIP )  :  (1),  (21),  (22)  with 


4  41 


S  =  {xeR^  :  0  s  5  6  ,  0  s  s  8  ) 

S  =  [xcR^  ;  2  S  +  X2  ^  6  ,  -9  s -3x^  +  x^  ^  9  }  . 


We  work  with  the  following  problem  (see  (47)  which  is  equivalent 
to  (43): 


maximize 


subject  to 


N 

(  ^  g;  V.  )  -  M  (Zj  +  z,) 


i=l 


’X  1 


^  S*!*  •  • 

8n  ; 

A  A  * 

-1 

-_9. 

0 

\\\ 

V 

1  0 

1 ... 

1 

1  f 

1 

i 

0 0  ; 

1 

0 

0 

s 

1 

\  0... 

1 

0  1 

l..e  1  1 

0 

0 

/ 

z  J 
*21 

1 

iV 

Iteration  0: 


81  = 


6\ 

8 


V  ,  V  ,  Zj  ,  z^  ^  0 


optimal  extreme  point  solutions  to  the  subproblems 


and 


max  X,  +  2x_ 
xc5  ^  2 


mjx  X  +  2x- 
xeS  ^ 


respectively.  Then  the  columns  of 


I 


17 


form  a  basis  which  gives  the  following  initial  basic  feasible  solution 
to  problem  (49):  ^ 


the  corresponding  simplex  multipliers  are 

(v.  Oj  ,  O2 )  a  (22,  0,  -M  ,  s  (M  ,  M  ,  22  -  14M  ,  6M). 

Iteration  1: 

Since  v  -  c^  a  (M  -  1.  M  -  2)  ,  (38)  and  (41)  give 


fi^\ 

+  9 

4 

* 

ii 

iii 

1 

\*  1  . 

The  corresponding  relative  costs  ((33)  and  (34))  are 


(w  -  c*)  g  *  +  Oj  a  -14M  +  22 
-V  g*  +  02  a  -  ^  M  . 


o\ 

0  enters  the  basis,  and  the  reader  can 

ij 

leaves.  The  new  basis  vectors  are  the 


-18 


/  6 


c  olumns  of 


B  = 


8 
I 

\  0 


3 

4 

il 

4 

C 


4  -i 


\ 


1 


0 

0 

0 


0 
L 

0  / 


and  the  new  basic  feasible  solution  is 


13 


-27-5  ^  ,  i:. 

''l'32'  ''2  =32  ■  ''!  =  *•  *1  =  16 


The  new  simplex  multipliers  are 


/M  ^  1m  n  121  ilM\ 


Iteration  2;  In  a  similar  manner,  t'le  reader  can  check  that 


(-  \ 

( 

r^i  - 

8 

1  ■ 

1  1 

\o  / 

\o 

enters  the  basis  and 


l^\ 

8i 

8 

i 

il 

\o  1 

10/ 

leaves. 


The  new  basic  feasible  solution  is 


5  ••  Z7  A  3 

V,  =  --=  ,  V-  =  -rr  ,  V,  =  I  ,  2,  =  -r ,  The  basis  matrix  is 
2  32  3  32  I  14 


B  = 


Iteration  3; 


3 

4 

f 

8 

.  27 

4 

1  1 

0 

\  0 

1 

sx  multipliers  < 

0, 

-M  , 

0)B"^ 

\ 

/ 

\  i 

1  4 

.1 

1  ' 

\; 

“\ 

0 


0 

0 


o/ 


3  .  27 


enters  the  basis 


and 


leaves  so  that  the  new  basic  feasible  solution 
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